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Abstract. In this paper we present the use of Constraint Program- 
ming for solving balanced academic curriculum problems. We discuss 
the important role that heuristics play when solving a problem using 
a constraint-based approach. We also show how constraint solving tech- 
niques allow to very efficiently solve combinatorial optimization problems 
that are too hard for integer programming techniques. 
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1 Introduction 

A key factor to take into account when evaluating the academic success of stu- 
dents is the academic load they have in each academic period. The usual way to 
measure this load is to assign, to each course, a number of credits representing 
the amount of effort required to successfully follow the course. In this way, the 
academic load of each period is given by the sum of the credits of each course 
taken in the period. Generally, some explicit restrictions are imposed when devel- 
oping a curriculum. For example, a maximum load per period could be allowed 
in order to prevent overload, and some precedence relationships could be es- 
tablished among some courses. Assuming that a balanced load favors academic 
habits and facilitates the success of students, since 1994 we have been involved 
in designing balanced academic curricula at the Federico Santa Maria Technical 
University. 

The problem of designing balanced academic curricula consist in assigning 
courses to periods in such a way that the academic load of each period will be 
balanced, i.e., as similar as possible. In this work, we consider as academic load 
the notion of credit that represents the effort in time needed to successfully follow 
the course. In this work, we concentrate on the Informatics careers offered by the 
Federico Santa Maria Technical University at Valparaiso. A first attempt in this 
direction was done on the curriculum of a four- year career (8 academic periods) 
considering 48 courses [|j . In that work. Integer Programming techniques allowed 
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to solve only 6 academic periods. However, it was not possible to solve the 
complete model. Considering the success of Constraint Programming for solving 
combinatorial search problems, we were interested in using this technique as an 
alternative. 

This paper is organized as follows: section |^ describes the combinatorial op- 
timization problem we are interested in. Section ^ presents an Integer Program- 
ming model for the balanced academic curriculum problem. In section 4, we 
model the same problem using a constraint-based approach. In section 5, we 
present experimental results when solving the problem using both approaches. 
Finally, in section 0, we conclude the paper and give some perspectives for further 
works. 



2 The Balanced Academic Curriculum Problem 

In this work, we concentrate on three particular instances of the balanced aca- 
demic curriculum problem: the three Informatics careers offered by the Federico 
Santa Maria Technical University. As a general framework we consider adminis- 
trative as well as academic regulations of this university. 

Academic Curriculum An academic curriculum is defined by a set of courses 
and a set of precedence relationships among them. 

Number of periods Courses must be assigned within a maximum number of 
academic periods. 

Academic load Each course has associated a number of credits or units that 
represent the academic effort required to successfully follow it. 

Prerequisites Some courses can have other courses as prerequisites. 

Minimum academic load A minimum amount of academic credits per period 
is required to consider a student as full time. 

Maximum academic load A maximum amount of academic credits per pe- 
riod is allowed in order to avoid overload. 

Minimum number of courses A minimum number of courses per period is 
required to consider a student as full time. 

Maximum number of courses A maximum number of courses per period is 
allowed in order to avoid overload. 



3 Integer Programming Model 

In this section, we present an Integer Programming model for the balanced 
academic curriculum problem. 

— Parameters 
Let 

m : Number of courses 

n : Number of academic periods 

tti : Number of credits of course i; Vi = 1, . . . , m 

/? : Minimum academic load allowed per period 

7 : Maximum academic load allowed per period 

6 : Minimum amount of courses per period 

e : Maximum amount of courses per period 

— Decision variables 
Let 




1 if course i is assigned to period j; Vi = 1, . . . , m Vj = 1, . . . 

otherwise 



n 



Cj-. academic load of period j; Vj = l,...,n 
c: maximum academic load for all periods 
— Objective function 




Cn} 



m 




i=l 



• All courses i must be assigned to some period j: 



n 




• Course 6 has course a as prerequisite: 




• The maximum academic load is defined by: 



c = Max{ci 




This can be represented by the following set of linear constraints: 



< c Vj = 1, . . . ,n 



• The academic load of period j must be greater than or equal to the 
minimim required: 

Cj > Vj = 1, . . . ,n 

• The academic load of period j must be less than or equal to the maximum 
allowed: 

Cj <jVj = l,...,n 

• The number of courses of period j must be greater than or equal to the 
minimum allowed: 

m 

^Xij >6yj = l,...,n 

i=l 

• The number of courses of period j must be less than or equal to the 
maximum allowed: 

m 

< eVj = l,...,n 

4 Constraint-Based Model 

In this section, we present our constraint-based model using the Oz language. 
4.1 Variables 

The domain constraints are the following: 



Variable Description Oz Implementation 

C Maximum academic load {FD . int 0#FD . sup C} 

(upper bound for all periods) 
Assignment Binary vector of assignments {FD. tuple assignment NK 

course-period (size N x K) 0#1 Assignment} 



4.2 Basic constraints 

Constraints involving only one variable and that allow to narrow the domains 
are: 



Description Oz Implementation 

Max;imum academic load C =< : Gamma 
Minimum academic load C >= : Beta 



4.3 Propagators 



The academic load of each period must be less than or equal to C. The product 
of the load vector by each column of the assignment matrix must be less than 
or equal to C. 

7o Academic load for period J 
{For 1 K 1 
proc {$ J} 
{FD . sumC 

{Map LIN fun {$ 1} {Nth I LoadVector} end} 
{Map LIN fun {$ 1} {Field I J} end} 
'=<:' C} 

end} 

Any course must be included only once. The sum of any column of the as- 
signment matrix must be 1. 

7o Any course must be done only once 
{For 1 N 1 
proc {$ 1} 
{FD . sum 

{Map LIK fun {$ J} {Field I J} end} 
'=:' 1} 

end} 

The number of courses assigned to any period must be less than or equal to 
the maximum allowed. The sum of any row of the assignment matrix must be 
less than or equal to the maximum allowed (Epsilon). 

°/o Maximum number of courses in a period 
{For 1 K 1 
proc {$ J} 
{FD . sum 

{Map LIN fun {$ 1} {Field I J} end} 
'=<: ' Epsilon} 

end} 

Each course must be assigned after its prerequisites. If the course to be 
assigned has any precedence constraint, then the simple constraint {Field A 1} 
= : is inserted because it could not be assigned to the first period. Then, for 
each ancestor, the propagators are implemented. 



°/o Course Precedence Relationship 
{ForAll Courses 
proc {$ Course} 
A P 

in 

A = {Order Course Courses} 
P = {Nth A PrecedenceRelations} 
if P \= nil then 
{Field A 1} =: 
{ForAll P 
proc {$ Preced} 
B 

in 

B = {Order Preced Courses} 
{For 2 K 1 
proc {$ J} 
{FD . sum 

{Map {List. number 1 J-1 1} fun {$ R} {Field B R} end} 
'>=: ' {Field A J}} 
end} 
end} 

end 

end} 

5 Experimental Results 

In this section, we detail the results obtained when solving the balanced aca- 
demic curriculum problem using integer programming and constraint program- 
ming techniques. We consider three careers involving 8, 10 and 12 academic 
periods, respectively. 

5.1 lp_solve: The Integer Programming Approach 

Several methods arc available for solving Integer Programming problems. Ex- 
plicit enumeration and cutting planes algorithms provide satisfactory results in 
some cases. However, Branch and Bound algorithms are the most successful tech- 
niques for solving Integer Programming models and are included in almost all 
mathematical programming packages. 

Specifically, when solving Integer Programming models that involve only bi- 
nary variables, Branch and Bound algorithms work in the following way: the 
original problem P is relaxed by eliminating constraints that impose integer 
values for the variables. Then, the relax;ed problem is solved by using linear pro- 
gramming techniques and, in case the solution docs not satisfy the requirement 
of integer values for the variables, two subproblems are created. The first one 
corresponds to the original problem P plus the additional constraint a; = 0, 



and the second one corresponds to the original problem P plus the additional 
constraint x = 1. The variable x is called the branching variable. Each time 
subproblems are created only worse solution can be obtained and this fact is 
used for bounding the search tree Q . 

Table ^ presents the results obtained using lp_solve|^ when solving the 8- 
period problem. In this case, the optimum plan is obtained in 1460 seconds. 



Solution quality 


Time 


Solution quality 


Time 


C [credits] 


[seconds] 


C [credits] 


[seconds] 


54 


1.69 


33 


9.35 


52 


1.80 


32 


11.63 


50 


2.09 


30 


11.94 


48 


2.41 


29 


53.64 


47 


2.97 


27 


54.04 


45 


3.28 


26 


136.45 


44 


3.91 


24 


137.08 


42 


4.24 


23 


218.23 


41 


4.92 


21 


218.43 


39 


5.20 


20 


712.84 


38 


6.18 


19 


1441.98 


36 


6.53 


18 


1453.75 


35 


9.04 


17 (optimum) 


1459.73 



Table 1. Partial and final solutions obtained by lp_solve for the 8-period prob- 
lem. 

Table || presents the results obtained when solving the 10-period problem. In 
this case, we obtained no optimum result after 5 hours, and the last result was 
logged before 1700 seconds. 



Solution quality Time 
C [credits] [seconds] 


Solution quality 
C [credits] 


Time 
[seconds] 


48 


5.88 


35 


8.84 


46 


5.89 


33 


9.11 


44 


5.93 


32 


25.38 


42 


6.00 


30 


25.65 


41 


6.14 


29 


1433.18 


39 


6.33 


27 


1433.48 


38 


6.72 


26 


1626.49 


36 


7.00 


24 (not optimum) 


1626.84 



Table 2. Partial solutions obtained by lp_solve for the 10-period problem. 



For the 12-period problem we did not get any log after a "turn-around-time" 
of 1 day. 



^ lp_solve, a software for solving integer linear programmi ng models, is available free 
of charge at ftp : //ftp . ics . ele . tue . nl/pub/lp_solve/ 



5.2 Oz: The Constraint-Based Approach 



Constraint Programming deals witli optimization problems using the same basic 
idea of verifying the satisfiability of a set of constraints. Asuming one is dealing 
with a minimization problem, the idea is to use an upper bound that represents 
the best possible solution obtained so far. Then we solve a sequence of CSPs 
each one giving a better solution with respect to the optimization function. 
More precisely, we compute a solution a to the problem P and we add the 
constraint / < a{f) that restricts the set of possible solutions to those that 
give better values for the optimization function]^. When, after adding such a 
constraint, the problem becomes unsatisfaible, the last possible solution so far 
obtained represents the optimal solution. 

When solving our constraint-based model implemented in Oz, we first used a 
naive heuristic over the assignment matrix to find a feasible solution. We did not 
have any other choice because the representation was a binary matrix involving 
n X m variables which are instantiated (with a or 1 value) or not instantiated 
(with a 0#1 domain) at any time. Because the other heuristics implemented by 
Oz (first fail, split) only apply to variables with bigger domains (e.g. first 
fail chooses the variable with minimal domain size) we only use the naive 
heuristic varying the order and interpretation of the vector of assignments. The 
way the program treats the assignment vector involves the variable ordering, and 
we could reverse the variable ordering by changing a function that is used along 
the model: 

fun {Field I J} 

Assignment. ((J-1)*N + I) 

end 

If we change the order of the matrix, then the variables are instantiated in 
a left-right manner always in the assignment vector but in a different way along 
the assignment matrix (interpretation of that vector). The Oz distributor is: 

{FD . distribute generic (order : naive value: max) Assignment} 

The first model we tested was the same model solved by lp_solve but now 
implemented as a CSP problem in Oz. The results for successive iterations reduc- 
ing C (the upper bound of the number of credits) are shown in figure 0, having 
obtained solutions before 5 hours only for the 8- and 10-period problems. 

The Oz performance was better than lp_solve giving poor quality solutions 
faster. But when we incremented C the problem got thighter and the latter still 
gave solutions (see tables ^ and ||) while Oz either ran out of memory^ or did 
not log any solution after 5 hours. 

^ Bockmayr and Kasper work on optimization functions / that always take integer 
values and so they add the constraint / < q(/) — 1 Q. 

^ That was an Oz internal error sent to bugs@mozart-oz.org. In fact, the entire search 
space (considering only distribution, not propagation) is rather big (2'*^" for the 10- 
period problem in 42 courses, 10 periods). 
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quality [credits] 



Fig. 1. Results obtained by the first implementation of the model in Oz com- 
pared with the lp_solve performance 



Inspecting the implementation, we noticed that the way Oz chooses the next 
variable to instantiate (left to right) from the binary vector is relevant to the 
way we interpretate that vector as a matrix. Varying then the variable ordering 
changed the results as shown in figure ^. 




Fig. 2. Results obtained varying the variable ordering in the Oz model 



We got the optimal solution for the 10-period problem, but still have problems 
reaching the 8-period problem optimum^ The 12-period problem reports partial 
solutions with C >= 28, but still far away from the optimum. 

Looking for the reason why Oz could not solve the 8-period problem, we tried 
changing another parameter, the value ordering. The way Oz was instantiating 
the variables was not natural because it was first trying the value which means 
not to assign the course to a period. Then it first prohibits any assignment 
until it gets a failed space, and backtracks searching for solutions. Given that 
for instantiating the courses we were using the variable ordering specified by 
the University's original academic curriculum, a good approach seemed to be to 
assign the courses in that order. Varying this value ordering we were able to get 
solutions for any quality requirement in a constant timc^ and get the optimum 
for every problem. The results are presented in figure |[ 



i#0 ordering - 8 periods 
0#1 ordering - 8 periods 
1#0 - 10 periods 
0#1 - 1 periods 




30 35 
quality [credits] 



Fig. 3. Results obtained varying the value ordering in the Oz model with the 
assignment vector grouped by period 



Finally, we compared the variable ordering with the new value ordering and 
got no significant differences as shown in figure H. 



* The optimum is reached at C = 17 in the 8-period problem, we did not have any 
response after 5 hours for C <= 18 with the assignment vector grouped by course. 

^ The fluctuations are due to machine noise and low precision in the Oz measurement 
tool used. 



grouped by period - 8 periods 1 

grouped by course - 8 periods x 

grouped by period - 10 periods 
grouped by course - 10 periods □ 
grouped by period - 12 periods ■ 
grouped by course - 12 periods — o — 

s r ? 



10 15 20 25 30 35 40 45 50 55 

quality [credits] 

Fig. 4. Results obtained varying the variable ordering in the Oz model with the 
value order reversed 



A comparative summary of the experimental results is given in table 



8-period problem 




lp_solve 


Oz 


grouped by course 


grouped by period 


naive 


reverse 


naive 


reverse 


Time in seconds for first 
solution (worst quality) 


1.7 


0.1 


0.1 


0.2 


0.1 


Time in seconds for optimum 
solution (best quality) 


1459.7 


oo 


0.1 


oo 


0.1 


f 0-period problem 


Time in seconds for first 
solution (worst quality) 


5.9 


0.2 


0.1 


0.2 


0.1 


Time in seconds for optimum 
solution (best quality) 


oo 


3.6 


0.1 


oo 


0.1 


f 2-period problem 


Time in seconds for first 
solution (worst quality) 


oo 


0.4 


0.5 


oo 


0.3 


Time in seconds for optimum 
solution (best quality) 


oo 


oo 


0.3 


oo 


0.3 



Table 3. Comparative summary of performance between lp_solve and Oz 



All details about the Integer Programming model and the implementation 
in Oz of the constraint-based model, as well as the results obtained using both 
approaches, can be obtained at ittp : //www . labsc . inf .utf sm. cl/~smajizELno. 



6 Related Work 

The works by Henz [|| and by Curtis, Smith, and Wren are the most recent 
references on the use of Constraint Programming and Integer Programming for 
solving combinatorial optimization problems. Dincbas, Simonis and Van Henten- 
ryck discuss a case in which the expressive power of Constraint Programming 
allows to reformulate an Integer Programming model giving a much smaller 
constraint-based model and reducing in this way the size of the search space Q . 
Van Hentenryck and Carillon [Q deal with a warehouse location problem and 
Smith, Brailsford, Hubbard and Williams apply both techniques for solv- 
ing the progressive party problem. In both cases, Constraint Programming does 
better than Integer Programming mainly due to the use of appropriated vari- 
ables. In our case, we do use the same variables and the same set of constraints. 
The very high efficiency of Constraint Programming was obtained thanks to the 
suitable heuristics used for enumerating the variables. 

7 Conclusions 

We have presented the use of constraint programming techniques for solving 
a combinatorial optimization problem. Using constraint programming we have 
been able to solve simple problems that cannot be solved by integer programming 
techniques. Moreover, we can solve medium size problems very efficiently. An 
important variablity can be obtained when using constraint programming: on 
one hand, using naive heuristics we can not solve even simple problems, on the 
other hand, using clever heuristics we can solve very efhciently some problems 
that are too hard for integer programming techniques. Of course, more work is 
needed to understand when to apply each of the heuristics used in this paper. 
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